Explicitly Modeled Attention Maps for Image Classification

Self-attention networks have shown remarkable progress in computer vision tasks such as image classification. The main benefit of the self-attention mechanism is the ability to capture long-range feature interactions in attention-maps. However, the computation of attention-maps requires a learnable key, query, and positional encoding, whose usage is often not intuitive and computationally expensive. To mitigate this problem, we propose a novel self-attention module with explicitly modeled attention-maps using only a single learnable parameter for low computational overhead. The design of explicitly modeled attention-maps using geometric prior is based on the observation that the spatial context for a given pixel within an image is mostly dominated by its neighbors, while more distant pixels have a minor contribution. Concretely, the attention-maps are parametrized via simple functions (e.g., Gaussian kernel) with a learnable radius, which is modeled independently of the input content. Our evaluation shows that our method achieves an accuracy improvement of up to 2.2% over the ResNet-baselines in ImageNet ILSVRC and outperforms other self-attention methods such as AA-ResNet152 in accuracy by 0.9% with 6.4% fewer parameters and 6.7% fewer GFLOPs. This result empirically indicates the value of incorporating geometric prior into self-attention mechanism when applied in image classification.Comment: Accepted by AAAI202

Deep Learning in Breast Cancer Imaging: A Decade of Progress and Future Directions

Breast cancer has reached the highest incidence rate worldwide among all malignancies since 2020. Breast imaging plays a significant role in early diagnosis and intervention to improve the outcome of breast cancer patients. In the past decade, deep learning has shown remarkable progress in breast cancer imaging analysis, holding great promise in interpreting the rich information and complex context of breast imaging modalities. Considering the rapid improvement in the deep learning technology and the increasing severity of breast cancer, it is critical to summarize past progress and identify future challenges to be addressed. In this paper, we provide an extensive survey of deep learning-based breast cancer imaging research, covering studies on mammogram, ultrasound, magnetic resonance imaging, and digital pathology images over the past decade. The major deep learning methods, publicly available datasets, and applications on imaging-based screening, diagnosis, treatment response prediction, and prognosis are described in detail. Drawn from the findings of this survey, we present a comprehensive discussion of the challenges and potential avenues for future research in deep learning-based breast cancer imaging.Comment: Survey, 41 page

β-hydroxybutyrate administration improves liver injury and metabolic abnormality in postnatal growth retardation piglets

Abnormal hepatic energy metabolism limits the growth and development of piglets. We hypothesized that β-hydroxybutyrate (BHB) might improve the growth performance of piglets by maintaining hepatic caloric homeostasis. A total of 30 litters of newborn piglets were tracked, and 30 postnatal growth retardation (PGR) piglets and 40 healthy piglets were selected to treat with normal saline with or without BHB (25 mg/kg/days) at 7-d-old. At the age of 42 days, 8 piglets in each group were sacrificed, and serum and liver were collected. Compared with the healthy-control group piglets, PGR piglets showed lower body weight (BW) and liver weight (p < 0.05), and exhibited liver injury and higher inflammatory response. The contents of serum and hepatic BHB were lower (p < 0.05), and gene expression related to hepatic ketone body production were down-regulated in PGR piglets (p < 0.05). While BHB treatment increased BW and serum BHB levels, but decreased hepatic BHB levels in PGR piglets (p < 0.05). BHB alleviated the liver injury by inhibiting the apoptosis and inflammation in liver of PGR piglets (p < 0.05). Compared with the healthy-control group piglets, liver glycogen content and serum triglyceride level of PGR piglets were increased (p < 0.05), liver gluconeogenesis gene and lipogenesis gene expression were increased (p < 0.05), and liver NAD+ level was decreased (p < 0.05). BHB supplementation increased the ATP levels in serum and liver (p < 0.05), whereas decreased the serum glucose, cholesterol, triglyceride and high-density lipoprotein cholesterol levels and glucose and lipid metabolism in liver of PGR piglets (p < 0.05). Therefore, BHB treatment might alleviate the liver injury and inflammation, and improve hepatic energy metabolism by regulating glucose and lipid metabolism, thereby improving the growth performance of PGR piglets

Conformation of hydrogen in deep earth

【Abstract】Hydrogen is the simplest atom and the most abundant element in the universe.Molecular hydrogen is a common form of hydrogen,The phase transition of molecular hydrogen at the ultrahigh pressure is the subject of great theoretical and experimental interest in the 1980's.However,whether there exists molecular hydrogen in deep earth is an important problem.This paper presents our recent results

Baicalin-Copper Complex Modulates Gut Microbiota, Inflammatory Responses, and Hormone Secretion in DON-Challenged Piglets

The present experiment assessed the inflammatory responses, hormone secretion, and gut microbiota of weanling piglets administered baicalin-copper complex (BCU) or deoxynivalenol (DON) supplementation diets. Twenty-eight piglets were randomly assigned to four groups: control diet (Con group), a 4 mg DON/kg diet (DON group), a 5 g BCU/kg diet (BCU group), a 5 g BCU + 4 mg DON/kg diet (DBCU group). After 14 days, the results showed that dietary BCU supplementation remarkably increased the relative abundance of Clostrium bornimense and decreased the relative abundance of Lactobacillus in the DBCU group (p < 0.05). BCU decreased the serum concentration of IgG, IL-2, IFN-γ, and IgA in DON treated piglets (p < 0.05), and promoted the serum concentration of IL-1β, IgG, IL-2, IFN-γ, IgA, IL-6, IgM, and TNFα in normal piglets (p < 0.05). BCU increased the concentrations of serum IGF1, insulin, NPY, GLP-1, and GH, and decreased the concentrations of serum somatostatin in no DON treated piglets (p < 0.05). Dietary BCU supplementation significantly promoted the secretion of somatostatin, and inhibited the secretion of leptin in piglets challenged with DON (p < 0.05). BCU regulated the expression of food intake-related genes in the hypothalamus and pituitary of piglets. Collectively, dietary BCU supplementation alleviated inflammatory responses and regulated the secretion of appetite-regulating hormones and growth-axis hormones in DON challenged piglets, which was closely linked to changes of intestinal microbes

Mannan oligosaccharides selenium ameliorates intestinal mucosal barrier, and regulate intestinal microbiota to prevent Enterotoxigenic Escherichia coli -induced diarrhea in weaned piglets

Enterotoxigenic Escherichia coli (ETEC) is a common diarrheal pathogen in humans and animals. To prevent and treat ETEC induced diarrhea, we synthesized mannan oligosaccharide selenium (MOSS) and studied its beneficial effect on ETEC-induced diarrhea. A total of 32 healthy weaned piglets (6.69 ± 0.01 kg) were randomly divided into four groups: NC group (Basal diet), MOSS group (0.4 mg/kg MOSS supplemented diet), MOET group (0.4 mg/kg MOSS supplemented diet + ETEC treatment), ETEC group (ETEC treatment). NC and ETEC group fed with basal diet, MOSS and MOET group fed with the MOSS supplemented diet. On the 8th and 15th day of the experiment, MOET and ETEC group were gavaged with ETEC, and NC and MOSS group were gavaged with stroke-physiological saline solution. Our data showed that dietary MOSS supplementation increased average daily gain (ADG) and average daily feed intake (ADFI) and significantly decreased diarrhea index and frequency in ETEC-treated piglets. MOSS did not affect the α diversity and β diversity of ileal microbial community, but it significantly decreased the proportion of lipopolysaccharide biosynthesis in ileal microbial community. MOSS supplementation regulated colonic microbiota community composition, which significantly increased carbohydrate metabolism, and inhibited lipopolysaccharide biosynthesis pathway in colonic microbial community. Moreover, MOSS significantly decreased inflammatory stress, and oxidative stress in ETEC treated piglets. Furthermore, dietary MOSS supplementation significantly decreased intestinal barrier permeability, and alleviated ETEC induced intestinal mucosa barrier irritation. In conclusion, our study showed that dietary MOSS supplementation ameliorated intestinal mucosa barrier, and regulated intestinal microbiota to prevent ETEC induced diarrhea in weaned piglets

Dietary Addition of Antioxidant Complex Packs and Functional Amino Acids Can Improve the Digestion, Absorption, and Immunity of Huanjiang Minipigs

To study the effect of functional amino acids and the antioxidant function compound package on Huanjiang minipigs and to lay a foundation for the formulation of green and efficient feed for Huanjiang minipigs, we added functional amino acids and the antioxidant function compound package to piglet feed for 28 days. After feeding, we detected the growth performance, biochemical indexes, inflammatory indexes, and intestinal disaccharidase of piglets. It was found that functional amino acids and the antioxidant compound package had certain effects on the growth performance and biochemical indexes of piglets and could reduce the level of IL-6 and increase the level of LZM and SIgA of piglets, and the levels of lactase and maltase in the intestine also increased significantly. The results showed that the compound package of functional amino acids and antioxidation could improve the growth performance and immunity of piglets and promote the digestion and absorption of nutrients in piglets

Chloroquine Improves Deoxynivalenol-Induced Inflammatory Response and Intestinal Mucosal Damage in Piglets

We investigated the effects of rapamycin (RAPA) and chloroquine (CQ) in supporting growth performance and the intestinal mucosal barrier in response to deoxynivalenol (DON) in piglets. A total of 32 healthy weaned piglets (bodyweight 7.10±0.58 kg) were divided into four groups and treated daily with RAPA (1 mg/kg BW), CQ (10 mg/kg BW), or a control volume of normal saline (two groups) until the end of the experiment. After feeding a basal diet for seven days, three groups were then switched to mildewed feed containing 1 mg kg/DON for a further seven days. In contrast to the control group, DON-treated piglets showed decreased average daily gain (ADG) and daily feed intake (ADFI), as well as negatively affected intestinal morphology as indicated by villus height, crypt depth, and tight junction protein expression. A group treated with RAPA and DON showed increased intestinal autophagy, aggravated inflammatory responses, and damage to the intestinal mucosa and permeability, leading to reduced growth performance. Meanwhile, a group treated with CQ and DON showed indices comparable to the non-DON control group, with alleviated inflammatory cytokines and healthy intestinal morphology and structure. They also showed better growth performance compared to DON treatment alone. These findings have important implications for mediating autophagy against DON in vivo, as well as the potential for CQ in improving growth performance and maintaining intestinal barrier integrity in weanling piglets

The investigation of chemical vapor deposited copper-based niobium films

The deposition of niobium film on copper with excellent superconducting property at low-temperature conditions, used as superconducting radio frequency (SRF) cavity, is a serious and urgent technical problem to be solved at present. In this work, copper-based niobium (Nb) films with a thickness of 1.5–1.8 um, regulating the deposition temperature parameters and gas flow velocity in a tube furnace, were prepared by low-temperature chemical vapor depositing (CVD) method from the reaction between H _2 and Niobium chloride (NbCl _5 ) under pure Ar atmosphere. Fabricated Nb films were characterized by X-ray diffraction, scanning electron microscopy and energy dispersive spectroscopy, respectively. The results showed that the excellent crystalline quality and superconductive performance of Nb films were generated successfully by CVD at low temperatures of 650 °C–700 °C. The preparation process was optimized during deposition and the formation mechanism of Nb films was also discussed in detail. The magnetic moment versus temperature of the Nb sample prepared at 700 °C was also measured and the well-prepared Nb film deposited in the boundary layer region obtains the desired superconducting transition temperature of 9.1 K ± 0.1 K, almost equivalent to that of high pure Nb bulk material. The optimized CVD reaction method of Nb film with favorable morphology and expected superconductive property at low temperature provided a new strategy and technical process in designing the desired copper-based Nb film SRF cavity